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1. Introduction and main result 

Suppose X := (X^, A; G Z) is a sequence of random variables on a probability space 
{Q,J-',P). This sequence X is said to be "strictly stationary" if for all choices of inte- 
gers j and £ and nonnegative integer m, the random vectors {Xj, ^j+i, . . . , Xj+rn) and 
{Xi, Xi+i, . . . , Xg+jn) have the same distribution. For a given integer N >2, the sequence 
X (stationary or not) is said to satisfy 'W-tuplewise independence" if for every choice of 
N distinct integers A;(l), k{2), . . . , k{N), the random variables Xfc(i), Xk(^2)i • • • i Xk{N) 
are independent. For N — 2 (resp. = 3), the word 'W-tuplewise" is also expressed as 
"pairwise" (resp. "triplewise" ) . 

Etemadi [5] proved a strong law of large numbers for sequences of pairwise indepen- 
dent, identically distributed random variables with finite absolute first moment. Janson 
[7] showed with several classes of counterexamples that for strictly stationary sequences 
of pairwise independent, nondegenerate, square-integrable random variables, the Central 
Limit Theorem (henceforth abbreviated CLT) need not hold. Subsequently, Bradley [2, 
Theorem 1] constructed another such counterexample, a 3-state one that has the addi- 
tional property of satisfying the absolute regularity (weak Bernoulli) condition. For an 
arbitrary fixed integer > 3, Pruss [9] constructed a (not strictly stationary) sequence 
of bounded, nondegenerate, A^-tuplewise independent, identically distributed random vari- 
ables for which the CLT fails to hold. In that paper, Pruss left open the question whether, 
for any integer N > 3, & strictly stationary counterexample exists. For = 3, Bradley [3, 
Theorem 1] answered that question by showing that the counterexample in [2, Theorem 1] 
alluded to above is in fact triplewise independent. 

In a similar spirit, for an arbitrary integer N >2, Flaminio [6] constructed a strictly 
stationary, finite-state, A'"-tuplewise independent random sequence X := (Xj., k & Z) which 
also has zero entropy and is mixing (in the ergodic-theoretic sense). That paper explicitly 
left open the question of whether those examples satisfy the CLT. 

In this paper, we shall answer affirmatively the question in [9], by constructing for 
an arbitrary fixed integer N > 2 a, strictly stationary, A^'-tuplewise independent sequence 
of bounded, nondegenerate random variables such that the CLT fails to hold. The con- 
struction will be in part an adaptation of the (not strictly stationary) counterexample in 
[9]. 

Before the main result is stated, a few notations are needed: 
The Borel cr-field on the real number line R will be denoted TZ. 
Convergence in distribution will be denoted by =^. 

The set of positive integers will be denoted by N. For a given sequence X := {X^, k e 
Z) of random variables, the partial sums will be denoted for n e N by 

Sn := S{X, n) := Xi + X2 + . . . + X„. (LI) 

Here is our main result: 

Theorem 1.1. Suppose N is an integer such that N >2. Then there exists a strictly sta- 
tionary sequence X := (X^, k E Z) of random variables such that the following statements 
hold: 
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(A) The random variable Xq is uniformly distributed on the interval [—3^/^, 3^/^] (and 
hence EXq = and EX^ = I). 

(B) For every choice of N distinct integers k{l), k{2), . . . , k{N), the random variables 
^kii), Xk{2), Xki^N) are independent. 

(C) The random variables \Xk\, k e Z are independent (and identically distributed). 

(D) For every infinite set Q <zN, there exist an infinite set T C Q and a nondegenerate, 
non-normal probability measure ji on (R, 7?.) such that Sn/'n}^'^ =^ A* ^ ^ ^i n E T. 

Here are some comments on Theorem 1.1: 

By property (A), the "natural normahzation" to consider for the central limit question 
for the partial sums of this sequence is S'^/n^/^. 

Property (B) is of course A^-tuplewise independence. 

By property (D) and the Theorem of Types (see e.g. [1, p. 193, Theorem 14.2]), there 
do not exist constants > and 6^ £ R for n e N such that anSn + bn=> -^(0, 1), even 
along a subsequence of the positive integers. 

Also by property (D) and an elementary argument, there do not exist constants 6„ G R 
for n G N such that n~^/^5'„ + 6^ ^ in probability, even along a subsequence of the 
positive integers. 

In property (D), the probability measure n may depend on the set Q. 

Remark 1.2. With essentially the same construction, one obtains an analog of Theorem 
1.1 with property (A) replaced by the following one: (A') The random variable Xq has the 
iV(0, 1) distribution. 

We did not investigate the ergodic-theoretic properties of the sequence X in Theorem 
1.1, nor did we try to ascertain the particular class of probability measures ^ that can arise 
in statement (D) there. Bradley [4] gives a construction of a (nondegenerate, two-state) 
strictly stationary, 5-tuplewise independent random sequence which fails to satisfy the CLT 
(instead, it satisfies property (D) in Theorem 1.1), and also has the extra properties of be- 
ing "causal" (for an appropriate use of that term) and therefore "Bernoulli" (i.e. isomorphic 
to a Bernoulli shift) and also having a trivial double tail a-field. There does not seem to be 
an obvious way to build those extra properties into the construction here for Theorem 1.1. 

The proof of Theorem 1.1 will be given in sections 2 and 3. It will be rather intricate 
and will require a fair amount of notation. Refer to properties (A) and (C) in Theorem 
1.1. The construction will basically involve taking a sequence of independent, identically 
distributed random variables uniformly distributed on the interval [— 3^^^, 3^/^], and chang- 
ing the signs of the variables in such a way as to introduce a dependence that preserves 
A'"-tuplewise independence but is incompatible with the CLT. 

In essence it involves the conversion of the (not strictly stationary) counterexample 
in [9] to one that is strictly stationary. The main ideas for that conversion were outlined 
in an e-mail message by one of the authors (Pruss [10]) to the other author (RGB), and 
are developed in section 3 here. Section 2 gives some vital "preliminary" information; 
much of it is taken or adapted from [9], but will be given again here in detail because 



3 



of considerable extra complications in our context. The use (in both sections 2 and 3) 
of higher order moments to establish property (D) in Theorem 1.1, is adapted from the 
analogous use of 6th moments for the same purpose in (an earlier, 2006 version of) the 
preprint [4] . Underlying all this is the repeated creation of "big" collections of A^-tuplewise 
independent random variables from "smaller" ones; such procedures are well known in the 
theory of error-correcting codes (see e.g. [8]). 

2. Part 1 of proof of Theorem 1.1 

Sections 2 and 3 together will give the proof of Theorem 1.1. Both sections will be 
divided into several "steps," including a "definition," some "lemmas," etc. Throughout this 
proof, the setting is a probability space (O, JF, P), "enlarged" as necessary to accommodate 
all random variables defined in this proof. 

Step 2.1. Let L be an arbitrary fixed integer such that 



To prove Theorem 1.1, it suffices to construct a strictly stationary, (L — l)-tuplewise 
independent random sequence X := (X/j, /c G Z) that also satisfies properties (A), (C), 
and (D) in Theorem 1.1. That will be the goal of sections 2 and 3. 

Step 2.2. The following notations and conventions will be used: 

(a) Refer to (2.1). For n G {0, 1,2,.. .}, when the term L"^ appears in a subscript or 
exponent, it will be written as L | n for typographical convenience. 

(b) Suppose n e N. A vector x G R"^ will often be represented as x := {xq, xi, . . Xn-i) 
(instead of {xi, X2, . . . , Xn)), for "bookkeeping" convenience. For a given x := (xq, xi, . . . , 
Xn-i) G R") define the two real numbers 



Notations of the form /((.xo, xi, . . . , Xn-i)) will be written simply as /(xq, xi, . . . , x„_i). 

(c) Sometimes the coordinates of a vector will be permuted. If n G N, x := (xq, Xi, . . . , 
^n-i) £ R"^: and o" is a permutation of the set {0, 1, ... ,n — 1}, then define the vector 
x^ G R" by Xa- := ((a:^)o, (X^)i, . . . , (X^)„_i) := (a;^(o), • • • , a;^(n-i))- 

(d) If (xfc, /c G Z) G R'^, and a < b are integers, then the vector {xa, Xa+i, ■ ■ ■ , xi) will 
also be denoted {xk : a < k < b). 

(e) A "measure" on the space R or R"^ (n G N) or R^ will always mean a measure 
on the Borel u-field on that space. 

(f) If is a random variable/ vector /sequence, then the distribution of ri on the ap- 
propriate space (such as R, R"^, or R'^) will be denoted C{r]). If also F is an event such 
that P{F) > 0, then C{r] \ F) will denote the conditional distribution of ry, given F. 

(g) For a given n G N, an "R'^-valued random vector" is simply a random vector 
with n coordinates. Of course, if n, m G N, r]i and r]2 are R'^-valued random vectors. 



J^iVi) = (on R'"), and / : R^ ^ R"^ is a Borel function, then C{f{'qi)) = Cifim)) 



L is even and L > 6. 



(2.1) 



n-l 



n-1 

and prod x := Y\ Xi. 

i=0 




(2.2) 



(on R"*). 
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(h) Several notations will be defined here. Suppose F := (Yj, z e /) is a family of 
random variables, where / is a nonempty (possibly infinite) index set. The cr-field of events 
generated by this family will be denoted o-{Y) or a{Yi, i E I). To avoid any confusion, this 
family Y is said to satisfy "(L — l)-tuplewise independence" if either (i) card / = 1, or 
(ii) card / > 2 and for every set ^ C / such that 2 < card S < L — 1, the random variables 
Yi, i & S are independent. (The point there is to formally include the case card 1=1 
in that terminology.) Here and below, "card" means cardinality. In the case of a random 
vector Y := (Yq, ^i, • • • , ^n-i), where n G N, the phrase "y satisfies (L — l)-tuplewise 
independence" simply means that the family of it coordinates (Fj, i G {0, 1, . . . , n — 1}) 
satisfies (L — l)-tuplewise independence. 

Step 2.3. Here a few useful functions on will be defined. 

Step 2.3(A). For each n G N, define the function ip^ : R"^ — > R"^ as follows: For x G R" 
(see (2.2)), 

{X if sum X > 
On if sum X = (2.3) 
—X if sum X < 

where 0„ denotes the origin in R". 

Thus for example (/?3(5, -7,4) = ip3{-b, 7, -4) = (5, -7,4). 

Remark 1. For each n G N and each x G R", sum ipn{x) = |sum x\. 

Remark 2. Suppose n G N, x := (xq, xi, . . . , x^-i) G R", y := v?n(a^) := (yo, Vi, ■ ■ ■ , 
i/n-i), and o" is a permutation of the set {0, 1, . . .,n — 1}. Recall from step 2.2(c) the 
notations x^ := (a:^(o), 2:^(1), • • • , a^<T(n-i)) and := (?/a(o), y<7(i), ■ ■ ■ , 2/a(n-i))- Then y^ = 
fnixa)- This holds by a careful trivial argument, using the fact that sum x^ = sum x. 
Thus for < z < n - 1 (see step 2.2(c) again), {ipn{.x^))i = {ya)i = ya{i) = {'Pn{x))a{i)- 

Remark 3. If n, x, and y are as in Remark 2 above (with y = (fnix)), and also 
sum X ^ 0, then \xi\ = \yi\ for each i G {0, 1, . . . , n — 1}. 

Remark 4- Suppose n G N, F is an R"-valued random vector (recall step 2.2(g)) such 
that C{—Y) = C{Y) and C{Y) is absolutely continuous with respect to Lebesgue measure 
on R"^, and F is a random variable independent of Y such that P{V = —1) = P{V = 1) = 
1/2. Then P(sum F = 0) = 0; and for any Borel set S C {x G R" : sum x > 0}, 

P(F eB) = P{-Y eB) = (1/2) • PiMY) e B); 

and hence by a trivial argument, jC{V(pn{Y)) = >C(F). 

Step 2.3(B). Refer to (2.1). Occasionally, "big" vectors will be created by the splicing 
together of L "smaller" ones. Suppose n is a positive integer, and for each £ e {0, 1, . . . , L — 

1}, a;(^) := (4^\a;5^\ . . .,x^n-i) ^ R-"- Then the notation 

^^(0)|^(l)|^(2)|...|^(L-l)^ (2.4) 

means the vector y := (yo, 2/1, ^2, • • • , VLn-i) € R'^"^ such that for each £ G {0, 1, . . . , L — 1}, 

{y£n,y£n+l, ■ ■ ■ ,y£n+n-l) = x'^^^ ■ 
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Step 2.3(C). For each n e N and each j e {0, 1, . . . , L — 1}, define the function : 
R-'""' R-^"- as follows: Suppose y G R^"". Represent y := (x*^*^^ | x^^^ I ■ ■ ■ I x^^~^^) as in 
(2.4), where for each £ e {0, 1, . . . , L - 1}, x^^^ e R'*. Then (see (2.2)) define 

J, ._ / 2/ if nfco'(sunixW) < , . 

n^nAV)- \(^(0)|...|^O-i)|_^O-)|a;O-+i)|...|a;(i-i)) ifnt-'(sumx(^))>0. 

That is, if ]^^^Q^(sum x^^^) > 0, then to define ipnjiy), one just multiplies by —1 the 
coordinates of x^^^ (the {j + 1)®* "n-coordinate piece" of y); all other coordinates of y are 
left alone. 

Preview. We shall show later on that if for each i E {0, 1, . . . , L — 1}, y^^^ is an R'^- 
valued random vector satisfying (L — l)-tuplewise independence (see (2.1)) and certain 
other conditions, and these random vectors Y^^\ £ e {0, 1, . . . , L — 1} are independent 
of each other, and one defines the R^'^-valued random vector Y := {Y^^^ \ Y^^^ I ' ' ' I 
Y^-'"~^^), then for any j G {0, 1, . . . , L — 1}, the R''""^-valued random vector ip^LjiY) satisfies 
(L — l)-tuplewise independence. Iterative use of this construction will generate the final 
sequence X := {Xk, /c G Z) for Theorem 1.1. 

Step 2.4. Here several special probability measures on R or R"^ or R^ will be defined. 

Step 2.4(A). The notation Aunpss will refer to the uniform distribution on the interval 
[—3^/^,3^/^], regarded as a probability measure on R. (The subscript "unps3" stands 
for uniform on the interval from negative to positive square root of 3.) For any positive 
integer m, the m-fold product measure AunpsS x '^unpsS x . . . x AunpsS on R"^ will be denoted 

^unps3- 

Remark. If ?7 is a random variable such that C{U) = AunpsS (see step 2.2(f)), then of 
course = for odd n G N and = {n+ 1)-^ ■ 3^/^ for even n G N. Hence, if 

also Z is a iV(0, 1) random variable, then (see e.g. [1, p. 275, eq. (21.7)]) for every n G N, 
EZ" > EW > (with equality for odd n and with EZ^ = EU'^ = 1). 

Step 2.4(B). Suppose n G N, and is a probability measure on R"^. Then the notation 
V{n, n) means the distribution on R^ of a random sequence Y := (Y^, A; G Z) such that 
(i) for each -u G Z, the random vector (("^ := (y„„, F„u+2, • • • , ^nw+n-i) satisfies 

^iC^^^) = ^■iid (ii) these random vectors (^'^\ u e Z are independent of each other. 

Step 2.4(C). Define (see (2.1) and (2.2)) the set T := {x G {-1,1}^ : prodx = -1}. 
Then card T = 2^~^. Let u denote the uniform distribution on T — that is, the probability 
measure u on R^ such that I'iix}) = l/2^~^ for each x eT. 

Step 2.4(D). Suppose n G N, and /x is a probability measure on R". Then define 
the probability measure Oip-) on R^" by ^(//) := J0,{Y) where the random vector Y := 
{Yq, Yi, . . . , YLri-i) is as defined below: 

Let W^^\ W^^\ . . . , W^^~^^ each be an R"'-valued random vector, such that £(VF*^^)) = 
jj for each £ E {0, 1, . . . , L — 1}, and such that these random vectors W^^\ £ E {0, 1, . . . , L — 
1} are independent of each other. Let V := (Vb, Vi, . . . , Vl-i) be a T-valued random vec- 
tor such that jC{V) = u (see step 2.4(C) above), with V being independent of the family 
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(W^^\ £ e {0, 1, . . . , L - 1}). Referring to step 2.3(A)(B), define the R^^-valued random 
vector Y by 

Y := (VoMW^''^) I V^ifniW^^^) I V2ipn{W^''^) I • • • I Vl-iMW^""'^^)) . (2.6) 

Remark 2.5. Suppose V :— (Vb, Vi, . . . , is a random vector such that C{V) = u 

(see (2.1) and step 2.4(C)). Then by elementary arguments, the foUowing statements hold: 

(i) For each /c e {0, 1, . . . , L - 1}, P{Vk = -1) = P{Vk = 1) = 1/2. 

(ii) V satisfies (L — l)-tuplewise independence. 

(iii) C{-V) = V. 

(iv) For every permutation a on the set {0, 1, . . . , L — 1}, the random vector Va := 
{Va{o),V^(^i), ^(L-i)) (see step 2.2(c)) satisfies C{Va) = i'. 

(v) prod V = —1 a.s. (see (2.2)). Hence for any j e {0, 1,...,L — 1}, 

= ~Ile€{0,l,...,L-l}-{j}^^ 

Definition 2.6. Suppose n e N, and is a probability measure on R". Then /j, is 
said to satisfy "Condition H{n)" if the following seven statements (a)-(g) hold, where 
W := (Wo) . . . , Wn-i) is a random vector such that JC{W) = ji: 

(a) /U is absolutely continuous with respect to Lebesgue measure on R"^. 

(b) For each A; G {0, 1, . . . , n - 1}, C(Wk) = AunpsS (see step 2.4(A)). 

(c) W satisfies (L — l)-tuplewise independence. 

(d) The random variables |Wo|, |Wi|, . . . , |W„_i| are independent (if n > 2). 

(e) C{-W) = ^. 

(f) For any j G {0, 1, . . . , n — 1}, there exists a permutation cr on the set {0, 1, . . . , n — 1} 
such that (i) (t(0) = j and (ii) C{W„) = (where W„ := (VF'^(o), W/'aCi), • • • , W^a(n-i)) — 
see step 2.2(c)). 

(g) Either (i) n < L, or (ii) n > L, and for every set S C {0, 1, . . . , n — 1} such that 
card S = L, one has that E([l-^g Wi) < 0. 

Lemma 2.7. Suppose n G N, and := (Wq, Wi, . . . , W„_i) is a random vector whose 
distribution C{W) on R" satisfies Condition T-C{n). Referring to (2.3), define tlie random 
vector Y := (pn{W) := (Yq, Yi, . . . , F„_i). Tien tie foiiowing tiree statements hold (see 
(2.2)): 

(i) E(sumF) = E|suml¥| > (l/2)n^/2_ 

(ii) /:{Yo) = /:{Y^) = --. = jr{Yr,_,). 

(Hi) For anyke{0,l,...,n- 1}, EY^ = (1/n) • E\s\xmW\. 

Proof. Let us first prove (i). Trivially sum Y = |sum W\ by (2.3). We just need to prove 
the ("latter") inequality in (i). 

Refer to (2.1) and Definition 2.6(b) (c). By simple calculations, including the argument 
in [1, p. 85, proof of Theorem 6.1] (which uses only 4-tuplewise independence), one has 
that for each /c G {0, 1, . . . , n - 1}, CiWk) = AunpsS, EWk = 0, EW^ = 1, and EW^ = 9/5, 
and hence £'(sum = n and 

E(sum Wf = n ■ EW^ + 3n(n - 1) • (EW^f < 3r?. 
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Hence by Holder's inequality, 



n = E{sum Wf < 



Isum . Isum VTI^/^ 

3/2 



= [£;|sum W\f/^- [E{snm W)^] 
<[£;|sum W^|]2/3.(3n2)'/'. 

Hence n"^/^ < -E|sum W\ ■ (3n^)^/^. Hence the ("latter") inequality in (i) holds. 

Now let us prove (ii). Suppose j e {0, 1, . . . , n — 1}. Referring to Definition 2.6(f), let 
a be a permutation of the set {0, 1, . . . , n — 1} such that (t(0) = j and C{Wcr) = C{W). 
Then C{ip^{W^)) = C{ipniW)) = C{Y). Also, = ifniW^) by Remark 2 in step 2.3(A), 
and hence C{Y^) = C{Y). Hence C{Yj) = C{Y^(o)) = C{Yo). Since j e {0, 1, . . . , n - 1} 
was arbitrary, (ii) follows. 

Statement (iii) follows trivially from statements (i) and (ii). 

Lemma 2.8. Suppose n G N, and /j, is a probability measure on R"^ that satisGes Condition 
H{n). Then the following statements hold: 

(A) The probability measure 6 (fi) on R^" (see step 2.4(D)) satishes Condition n{Ln). 

(B) Suppose W is an H^"^ -valued random vector of the form 

W := {Wo, W,,..., Wlu-i) := (C^°^ I C^'^ I C^'^ I • • • I C^"^"'^) (2-7) 



(see (2.4)) where (i) for each £ e {0, 1, . . . , L - 1}, C^^^ 

is an Il^-valued random vector such 
that C{C^^'^) = n, and (ii) these random vectors (^^^\ £ e {0, 1, . . . , L — 1} are independent 
of each other. Then (see (2.5)) for every j e {0,1, . . . , L - 1}, £(V'nj(W^)) = 0{fJ')- 

(C) Suppose the -valued random vector W is as in statement (B) (satisfying all 
conditions there), and Y := {Yq, Yi, . . . , Yl^-i) Is an H^^-valued random vector such that 
C{Y) — 9{ii). Suppose S is a nonempty subset of {0, 1, ... , Ln — 1}. Then the following 
statements (i), (ii), (iii) hold: 

(i) For each integer M e {1,2, . . . , L - 1}, £^(Efce5 ^fc)^ = ^^(Efces Wk)^ . (In the 
case where M is odd, both sides of that equality are 0.) 

(iii) For the case where 5 = {0, 1, ... , Ln — 1} itself, one has (see (2.2)) 

E(sum W)^ - E(sum Y)^ > 2'^ ■ LI ■ n^/^. (2.8) 



Statements (A) and (B) and their proofs are taken or adapted from [9]. Their proofs 
will be included here because of extra complications in our context. 

Proof. The proofs of statements (B), (A), and (C) will be given in that order. 

Proof of statement (B). Before the random vector W in statement (B) is brought into 
the picture, some preliminary work is needed. 

Let j e {0, 1, . . . , L — 1} be arbitrary but fixed. (See the role of j in statement (B).) 
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Let Vq,V(, . . . ,V[_^ be independent, identically distributed {—1, l}-valued random 
variables such that ^(V'q = —1) = P{Vq = 1) = 1/2. Define the random vector V* := 
{Vq*, V{,..., V2_i) as follows: For each £ e {0, 1, . . . , L - 1} - {j}, V; := V/; and 

^-■=- n (2.9) 

ie{o,i,...,L-i}-{j} 

Now the random variables Vg, i E {0, 1, . . . , L — 1} — {j} are independent and iden- 
tically distributed, P{V; = -1) = P(F/ = l) = 1/2 for each £ e {0,1, . . . , L - 1} - {j}, 
and (2.9) holds. These conditions together uniquely determine C{V*). Also, the random 
vector V (with C{V) = u) in Remark 2.5 satisfies the analogs of those conditions (see 
Remark 2.5(i)(ii)(v)). It follows that 

£(F*) = V. (2.10) 

Next, let ^^^\^^^\ ■ ■ ■ be independent R^-valued random vectors such that 

(i) C{^W) = iJ for each£ G {0, 1, . . . , L - 1} and (ii) (t(^W, ^(i), . . . , ^(-^"i)) is independent 
of cr{V') (and hence independent of a{V*)) — see step 2.2(h). Define the R^'^-valued 
random vectors W and W* by (see (2.3) and (2.4)) 

W := {W(„Wi,...,Wi,_,) 

■■= (K^n(e(°^) I ^lVn(e^^)) I • • • I VU^ni^(^-'^)) (2.11) 

and 

W* := {W*,W*,...,Wl^_,) 

■■= (^oVn(^^°)) I ^iVn(e^'^) I ■ ■ ■ I Vl_,^r^{C'^-'^)) ■ (2.12) 



By (2.10), (2.12), and step 2.4(D), 

£{W*)=e{p). (2.13) 

Since (by hypothesis) n satisfies Condition Tiin), one has by Definition 2.6(a) (e) and 
Remark 4 in step 2.3(A) that V £ G {0, 1, . . . , L - 1}, 

C{Vlipn{i^'^)) = C{i^'^) = ^Ji. (2.14) 

Also, the random vectors Vl(fn{^^^^)i ^ G {0, 1, . . . , L — 1} are independent (by the prop- 
erties above). Hence by (2.11) and (2.7) and the (other) assumptions in statement (B), 

C{W') = C{W). (2.15) 

Our next task is to compare the random vectors W and W* . For that purpose, 
observe that by (2.14) and Definition 2.6(a) (and the hypothesis of Lemma 2.8), 



and for all a; e f2 not in that event, 



V'{u;)M^(^\^)) if nt"o sum(V/(a;)^.(e(^)(a;))) < 0. 



To verify (2.16), consider first the case where ni'=o^ sum(y/(c<;)(/7„(^'^^)(c<;))) > 0. This can 
be rewritten as nto^[V^'('^)- sum v;^(^(^)(u;))] > 0, or [ Ilto^ ^/('^)]"[ Ilfco^ sum v;^(^(^)(u;))] > 
0. Since sum (pn {^^^\u})) > for each £ e {0, 1, . . . , L - 1}, this forces Uf^o ^/(^) = 1- 
That in turn implies Vj{(jj) = Yie^^j ^ei'^)i hence by (2.9) and its entire sentence, 

v;{oo) = - n ^/('^) = - n ^A^) = -^'(^), 

and hence (2.16) holds. In the other case, where nflTo^ sum(V£'(a;)<^n(C^^H<^))) < 0) ^q. 
(2.16) holds by a similar argument. 

Now of course V^/v'n(^^^^) = V"/v?n(C^^^) for each £ e {0, 1, . . . , L - 1} - {j}. Hence by 
(2.5), (2.11), (2.12), and (2.16) and its entire sentence, 

^n,j{W') = W* a.s. (2.17) 

Now by (2.15), (2.17), and (2.13), C{i;n,j{W)) = C{i;n,j{W')) = C{W*) = ^(/x). Since 
j G {0, 1, . . . , L — 1} was arbitrary, statement (B) in Lemma 2.8 holds. 

Proof of statement (A). This will be a continuation of the argument above for statement 
(B). (The integer j in that argument will not play a role here; as a formality, one can take, 
say, j = 0.) Using (2.12) and (2.13), we shall verify, one by one, the analogs of conditions 
(a)-(g) in Definition 2.6 for the probability measure 9{n) on R^"^. 

By (2.14) and the paragraph after (2.10), £(^(°), ^^i), . . . , ^(-^"i)) = x x ■ ■ ■ x 
(the L-fold product measure on (R")^), which (by Definition 2.6(a) for /j, and a standard 
measure-theoretic argument) is absolutely continuous with respect to Lebesgue measure on 
(R"^)^. Hence by (2.3), Definition 2.6(e) for and an elementary argument, C{(pni^^^^), 
Vni^^^^), - • ■ , ^niC^^~^'^)) is absolutely continuous. Hence so is C{W*), by (2.12) and an 
elementary argument. Hence by (2.13), the analog of condition (a) in Definition 2.6 holds 

for e{i^). 

Next, by (2.14), (2.10), Remark 2.5(i)(ii), and the paragraph after (2.10), one has that 

V £ e {0, 1, . . . , L - 1}, C{V;ipn{^^'^)) = £(V,V„(^W)) = /X, (2.18) 

and also that every L — 1 of the random vectors V^cpni^^^''), i £ {0, 1, . . . , L — 1} are 
independent. Hence by (2.12), Definition 2.6(b)(c) for fi, and a simple argument, one has 
that C{W^) = Aunpss for each k G {0, 1, . . . , Ln — 1}, and that the random vector W* 
satisfies (L — l)-tuplewise independence. Hence by (2.13), the analogs of conditions (b) 
and (c) in Definition 2.6 hold for ^(/x). 

Next, by (2.7) and its entire sentence, together with Definition 2.6(d) for the random 
variables |Wj|, i G {0, 1, . . . , Ln — 1} are independent. Hence by (2.15), the same holds 
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for the random variables IVF/I, < i < Ln — 1. Now by (2.11), (2.12), and the entire 
paragraph containing (2.9), \W*\ = \Wl\ for each i G {0,1,..., Ln — 1}; and hence the 
random variables \W*\, < i < Ln — 1 are independent. Hence by (2.12) and (2.13), the 
analog of condition (d) in Definition 2.6 holds for 6'(//). 

Next, by (2.10), Remark 2.5(iii), and the paragraph after (2.10), 

C{V*, ^(1), . . . , ^(^-1)) = ^x/ix/.x...x/. 

= C{-V\ ^("^ e(^-^)). (2.19) 

Also, by (2.12), W* = fiV*,C^^\^^^\ . . .,^^^~^^) for an obvious Borel function / : x 
(R'^)^ ^ R'^-^, and -W* = f{-V*,^^^\^^^\...,^^^-^^). Hence C{~W*) = C{W*) by 
(2.19). Hence by (2.13), the analog of condition (e) in Definition 2.6 holds for 0{fi). 

Proof of Definition 2.6(f) for 9{ii). Refer to the notations in step 2.2(c), and refer to 
Remark 2 in step 2.3(A). 

Let J e {0, 1, ... , Ln — 1} be arbitrary but fixed. Refer to (2.12) and (2.13). To prove 
the analog of property (f) in Definition 2.6 for ^(/i), it suffices to show that there exists a 
permutation r of the set {0, 1, ... , Ln — 1} such that 

t(0) = J and £(M^;) = C{W*). (2.20) 

Let f e {0, 1, . . . , L - 1} and j' e {0, 1, . . . , n - 1} be such that 

J = + /. (2.21) 

Let q; be a permutation of the set {0, 1, . . . , L — 1} such that a{0) — I' . Then by (2.19), 
(2.10), and Remark 2.5(iv), 

^ . . . , = vxiJiXiJiX...xiJL. (2.22) 

Applying Definition 2.6(f) for // (see (2.14)), let /9 be a permutation of the set {0, 1, . . . , n — 
1} such that /?(0) = j' and (say) C{^^p^'^^^) = Then by (2.22) and a trivial argument, 

C (^«% 4"^°^ . . . , = ^ X X ^ X . . . X ^. (2.23) 

Define the R^"-valued random vectors W** and W*** by 
W** := (Wo**, Wi**, . . . , Wll_^) 

■■= {{V*)oVn{&^'^^) I {V:\Vn{&^'^^) I • • • I {V:)^_,Vn{&^'^-'^^)) (2.24) 

and 

Wi***, • • • , Wi**_i) 

:= {{v:)o^n{if^'^^) I (K:)i¥'n(^("™) I {v:)^^^{e-^^)^) \ 

■■■\{V:)^_,^r.{&^^-'^))). (2.25) 
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By (2.19) (its first equafity), (2.22), (2.23), (2.24), (2.25), (2.12), and (2.13), 

jr{W***) = C{W**) = C{W*) = e{n). (2.26) 

By (2.21) and the sentence after it, together with (2.24) and (2.12), the random 
variables W^* , < k < Ln — 1 in (2.24) are (to put this informally) simply a permutation 
of the random variables W^, < k < Ln - 1 in (2.12), such that W** = WJ. Similarly, 
by (2.24), (2.25), Remark 2 in step 2.3(A), and the sentence after (2.22), the random 
variables W^**, < k < Ln — 1 in (2.25) are simply a permutation of the random variables 
W^*, < k < Ln — 1 in (2.24), such that Wq** = W**. Hence the random variables 
W^**, < k < Ln — 1 in (2.25) are simply a permutation of the random variables W^, 
< k < Ln - 1 in (2.12), such that Wq** = Wj. Thus for the resulting permutation r 
of the indices {0, 1, . . . , Ln - 1}, one has that W*** = W* and by (2.26), equation (2.20) 
holds. That completes the argument for Definition 2.6(f) for 9{iJ,). 

Proof of Definition 2. 6(g) for 9{fi) . Let S be an arbitrary fixed subset of {0, 1, . . . , Ln— 
1} such that card S = L. Refer to (2.12) and (2.13). Our task is to show that E{]\j^^g W^) < 
0. 

For each £ e {0, 1, . . . , L — 1}, define the set 

$(£) := {In, en + l,...,en + n-l}. (2.27) 

These sets form a partition of the set {0, 1, . . . , Ln — 1}. The argument here will be divided 
into three cases according to how many indices £ G {0, 1, . . . , L — 1} are such that the set 
S n $(^) is nonempty. First recall from (2.12) that for each £ G {0, 1, . . . , L — 1}, 

iwL,wi^+,,...,w;^+n-i) = v;m^^'^)- (2.28) 

Case L S G $(£) for some £ G {0, 1, . . . , L - 1}. Then by (2.28) and (2.27) (for that 
£), (2.18), and Definition 2.6(g) for E{Ylf^^gW^) < 0. 

Case 2. The set T := {£ G {0, 1, . . . , L-1} : Sn^{£) ^ 0} satisfies 2 < card T < L-1. 
This forces card(^n$(£)) < L - 1 for each £ G T. For each £ G T, by (2.28), (2.27), (2.18), 
and Definition 2.6(b)(c) for ^, E{YlkeSnm ^k) = UkeSnm = 0- Also, by (2.28), 

(2.27), and the phrase immediately after (2.18), the cr-fields cr{W^, k e Sn $(£)), £ G T 
are independent. It follows that -Edlites ^k) = ^■ 

Case 3. For each £ G {0, 1, . . . , L — 1}, the set $(£) contains exactly one element of 
S. (Recall that card S = L.) For each £ G {0, 1, . . . , L — 1}, let k{£) denote the element 
of n $(£). By (2.12), for each £ G {0, 1, . . . , L - 1}, W*^^-^ = V/Ti where Tg is one of 

the coordinates of the random vector (fniC^^^)- For each £ G {0, 1, . . . , L — 1}, ETi > 
by (2.14) and Lemma 2.7(i)(iii). Hence by (2.10), the paragraph after (2.10), and Remark 
2.5(v), 

\ /L-1 \ L-1 




L-1 

= -1 l[ETi< 0. 



.e=Q / \£=0 J t=Q 

L-1 
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That completes the argument for Case 3, for Definitfon 2.6(g) for 9{fj,), and for state- 
ment (A). 

Proof of statement (C). In this argument, for any R^'^-valued random vector rj := 
iVOi ^1, ■ • • 5 VLn-i) and any nonempty set Q C {0, 1, ... , Ln — 1}, the notation (rjk, k E Q) 
will sometimes be used to denote the random vector (?7fc(i)7 ^(2)7 • • • 7 %(m)) where m = 
card (5 and k{l), k{2), . . . , k{m) are in strictly increasing order the elements of Q. 

We shall use appropriate arguments from the proofs of (A) and (B). 

For any nonempty set Q C {0, 1, . . . , Ln — 1} such that card Q < L — 1, one has (see 
step 2.4(A)) that 

C{Wk, keQ)= At^|,,3 = C{Yk, k e Q). (2.29) 

The first equality holds by the entire sentence containing (2.7), together with Definition 
2.6(b) (c) for n and a simple argument. The second equality holds by Definition 2.6(b) (c) 
for 6'(/i) (recall statement (A), proved above). 

Refer to the set S in statement (C). To prove item (i) in statement (C), note that if 
1 < M < L - 1, then for any M-tuple (/c(l), k{2), K{M)) e (the k{iys need not 
be distinct), -E'dli^i ^A;(i)) — {Y\ALi^k{i)) by (2.29) and its entire sentence. Adding up 
over all M-tuples G , one obtains ^^(Efcgg Wk)^ = E{J2kes ^k)^ ^ the equality in (i). 
The last sentence in (i) follows from Definition 2.6(e) for 0{p) (applied to Y). 

Proof of statement (C)(ii). Let (/c(l), /c(2), . . . , /c(L)) be an arbitrary fixed L-tuple 
G 5'''". (The /c(i)'s need not be distinct.) In order to prove statement (C)(ii), it suffices to 
prove that 

E {\{ j < E [\{ Vr,(,) j . (2.30) 

(For then by adding up both sides over all L-tuples G , one would obtain statement 
(C)(ii).) 

If two or more of the integers k{i) are equal, then (2.30) holds with equality by (2.29) 
and its entire sentence. Therefore, we now assume that the integers k{i) are distinct. 

Now refer to the sets $(£), £ G {0, 1, . . . , L-1} in (2.27). Suppose first that {/c(l), /c(2), 
...,/c(L)} C $(£') for some £' G {0, 1,...,L - 1}. By (2.27) and (2.7) and its entire 
sentence, 

C{Wk,ke $(£')) = >C (C^^'^) = 11. (2.31) 

Also, since C{Y) = e{^l) = C{W*) by (2.13) and the assumption on Y, one has by (2.27), 
(2.12), and (2.18), 

£(n, k G $(f )) = C{W^, k G $(f )) = C{V;,iprr{C^''^)) = fi. (2.32) 

Hence £(1^(1), >fc(2), • • • , Yk{L)) = >C(M^a;(i), W^fc(2), • • • , W^fc(L)), and (2.30) holds with equal- 
ity. 

Now consider the remaining case where {k{l), k{2), . . . , /c(L)}n$(£) is nonempty for at 
least two indices £ G {0, 1, . . . , L — 1}. Then none of the sets ^{i), £ G {0, 1, . . . , L — 1} can 
contain more than L — 1 of the integers k{i). Now (2.31) holds for any G {0, 1, . . . , L — 1}; 
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and hence by Definition 2.6(b) (c) for yu, one has that for any i e {0, 1, . . . , L — 1} such that 
{A;(l), . . . , k{Ly\ n $(^) is nonempty, E W VFfc(i) = where the product is taken over aU 
i G {0, 1, . . .,L} such that k{i) G $(^). Also, by (2.27) and (2.7) and its entire sentence, 
the a-fields a{Wk, k G $(^)), ^ G {0, 1, . . . , L — 1} are independent. It foUows that 
-^(IliLi ^k{i)) = 0- Since (by hypothesis) C{Y) = 6{ij,), one has by Definition 2.6(g) for 
9{lJ,) that -E(n^i ^A;(i)) < 0. Thus (2.30) holds. That complets the proof of statement 
(C)(ii). 

Proof of statement (C)(iii). Refer again to (2.27). For each I G {0, 1, . . . , L — 1}, 
define the random variables 



r/^ := Wk and 



A;e*(£) 



(2.33) 



Then 



L-l L-l 

sum W = ^2 v'e and sum 

£=0 e=o 

By (2.27) and (2.7) and its entire sentence (note that ry^ = sum (^^^ for each £ G 
{0, 1, . . . , L — 1}), the random variables r/^, £ G {0, 1, . . . , L — 1} are independent. Recall 
again that C{W*) = 9{fj,) = £{¥) by (2.13) and the assumption on Y. By (2.33), (2.27), 
(2.12), and the phrase immediately after (2.18), every L — 1 of the random variables ?7|, i G 
{0, 1, . . . , L-l} are independent. Hence by (2.31), (2.32), and (2.33), if j{l),j{2), . . .,j{L- 
1) are distinct elements of{0,l,...,L — 1}, then 

^ (^i(l)' ^i(2)' • • • ' Vj(L-l)) = ^ {vj{l),Vj{2)^- ■ ■ > Vj(L-l)) ■ 

Hence, if j(l), j(2), . . . ,j{L) are each an element of {0, 1, . . . , L — 1} and two or more of 



the j{iys are equal, then E{Y[i=iVj(i)] 
calculation. 



E(U.i=i''lj{i))- Hence by (2.34) and a simple 



E{sumW)^ - E{sumY)^ = L\ 




(2.35) 



Now by (2.7) and its entire sentence, and Definition 2.6(b) for //, one has that EWk = 
for each G {0, 1 . . . , Ln — 1}; and hence by (2.33), Erj'g — for each i G {0, 1, . . . , L — 1}. 

Hence by the sentence after (2.34), -E(n^^o^ v'e) = 0- Hence by (2.35), 



'L-l 



E(suinW)^ - E{sum Y)^ = -Ll-EiJ2 



VI 



(2.36) 



Now recall again the equality C{W*) = C{Y) in the second sentence after (2.34). By 
(2.33), (2.27), and (2.12), 



E 




= E 



L-l 



1=0 



Hsum F,V„(e(^)) 



= E 



L-l 



n (v;-sum(^„(C(^)))) 
e=o 
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Hence by (2.10), Remark 2.5(v), and the sentence after (2.10), 




E 



L-l 



-1-[e (sum(^„(e(°)))" 



(2.37) 



Now by the sentence after (2.10), together with Lemma 2.7(i), i?(sum(/7„(^("))) > (l/2)n-'-/^ 

Hence by (2.37), EiUiJ vl) < -2"^ 
pletes the proof of statement C(iii), and of Lemma 2. 



Hence by (2.36), eq. (2.8) holds. That com- 



Lemma 2.9. Suppose n is a positive integer, and fi is a probability measure on 
that satisGes Condition 7Y(n) (see DeGnition 2.6). Suppose W := {Wk, k E Z) and 
Y := (Yfe, A; e Z) are random sequences such that (see step 2.4(B) (D)) C{W) — 'D{n,ii) 
and C{Y) = T>{Ln, 9{fj,)). Then the following statements hold: 

(A) The random variables Wk, /c G Z satisfy {L — l)-tuplewise independence as well 
as (for all k e Z) C{Wk) = AunpsS (see step 2.4(A)); and the same holds for the random 
variables Yk, k E Z. 

(B) For any nonempty Gnite set S dZ, one has that E{^i^^g Y^)^ < -^(^^^g Wk)'^. 

(C) If j e Z, and S is a Gnite subset of Z such that {j,j + l,j + 2, . . . ,j + 2Ln — l} C S, 

then 




^Wk 



-E[J2Yk] >2 

Kkes 



-L 



(2.38) 



Proof. Statement (A) holds by Lemma 2.8(A), Definition 2.6(b)(c) (for both and O(ijl)), 
step 2.4(B), and a trivial extra argument. 

Statements (B) and (C) will be proved together. For that purpose, define for each 
■u e Z the set 

A(w) := {Lnu, Lnu + 1, Lnu + 2, . . . , Lnu + Ln — 1}. (2.39) 

In this argument, we shall follow the convention in the first paragraph of the proof of 
statement (C) in Lemma 2.8. By step 2.4(B) and a trivial argument, the random vectors 
{Wk, k G A(u)), u e Z are independent of each other; and the random vectors (Ffe, 
k e A(w)), u E Z are independent of each other. 

Now suppose 5 is a nonempty finite subset of Z. Let Q denote the (nonempty, finite) 
set of all integers u such that the set S (1 A{u) is nonempty. For each q e Q, define the 
random variables 

E ^^-■= E ^i^- (2.40) 

kesnA{q) keSnA{q) 

Then 

E^'^ = E^^ E^'^^E^^- (2.41) 

fees q€Q fees qeQ 

Now for each e Z, by step 2.4(B), the random vectors {WLnq, WLnq+i, ■ ■ ■ ■, WLnq+Ln-i) 
and {YLnq, YLnq+i, ■ ■ ■ ■, YLnq+Ln-i) Satisfy the hypothesis of Lemma 2.8(C). Hence for each 
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g e Q and each m e {1, 2, . . . , L - 1}, by (2.40) and Lemma 2.8(C) (i), ^^(T^)™ = EiT*)"". 
Also, the random variables T'^^ q E Q are independent, and the random variables T*, 
q E Q are independent, by (2.40), (2.39), and the two sentences right after (2.39). Hence, 
if a given L-tuple (q(1), q(2), . . . , q{L)) e is such that at least two of the entries q{i) 
are different from each other, then by a simple argument, -EdliLi ^o(i)) = -^(Ili^i '^a(i))- 



Hence by (2.41) and a simple calculation, 



E 



.kes 



E 



.fees 



^ [i?(T^)^ - e{t;)^] 



(2.42) 



E{T^)^ > E{T*)^ 



Now by (2.40), the sentence after (2.41), and Lemma 2.8(C) (ii) 
for every q E Q. Hence by (2.42), statement (B) (in Lemma 2.9) holds. 

To continue this argument in order to prove statement (C), note that under the hy- 
pothesis of (C), there exists p E Q such that (see (2.39) again) A{p) C S. By (2.40), the 
sentence after (2.41), and Lemma 2.8(C)(iii), E{T^)^ - E{T*)^ > 2"^ ■ L! ■ n^/^. Hence 
by (2.42) and the sentence right after it, equation (2.38) holds. That completes the proof 
of statement (C), and of Lemma 2.9. 



3. Part 2 of proof of Theorem 1.1 

This section is a direct continuation of section 2. As in section 2, the argument here 
in section 3 will be divided into several "steps," including some "lemmas." 

Step 3.1. Refer again to the even integer L > 6 fixed in step 2.1. Refer to steps 2.2(a) 
and 2.4(A) (D). Recursively define as follows, for each n G {0,1,2,...}, the probability 
measure on R-^^": (i) hq := Aunpss, and (ii) for each n > 0, Hn+i '■— 0{pn)- 

Remark. For each n G {0,1,2,...}, the probability measure /i„ satisfies Condition 
T-C{L^). (For n = 0, that holds by Definition 2.6 and a trivial argument; and then for 
n > 1, it holds by Lemma 2.8(A) and induction.) 

For the next lemma, and for the rest of section 3 here, let Z be a A''(0, 1) random 
variable. 

Lemma 3.2. Suppose h and m are positive integers such that m < h. Suppose Y :— (Yk, 
k E Z) is a random sequence such that C{Y) = V^L^, n^.) (see step 2.4(B)). Suppose S is a 
finite set C Z such that for some integer j, one has that {j, j + 1, j + 2, . . . , j + 2L'^ — l}cS. 
Then 



E 



.k£S . 



< E 



{cardS)^/^z] - 2-^ • L! • L^"*-^)-^/^ 



(3.1) 



Proof. For each n G {0, 1, 2, . . . }, let M^(^) := {wj^''\ A; G Z) be a random sequence such 
that >C(W^(")) = P(L^, f^n)- Then by Lemma 2.9(B), 



Vn>l, E 





L 






< E 


E<"' 


.k£S 




.fees 



(3.2) 
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Also by Lemma 2.9(C) (with n = L"* ^) and the assumptions on 



E 



.fees 



.kes 

Combining that with (3.2) and trivial induction, one has that 



yn>m, E 



.kes 



(n) 



< E 



.kes 



(0) 



■ L\ ■ ipn-^)^!"^. 



Since > m (by hypothesis) and C,{Y) = C{W^'''^), it follows that 



E 



.k€S . 



< E 



Hence, to complete the proof of (3.1), it suffices to prove that 



.fees 



(0) 



E 



.keS 



< E 



{card Sy/^Z 



(3.3) 



Now (see steps 3.1 and 2.4(A) again), the random variables wlf\ k e Z are indepen- 
dent and identically distributed, with C{Wq'^) = Aunpss- Let Z^, e Z be independent 
A'"(0, 1) random variables. If p is a positive integer, k{l), k{2), . . . , k{p) are distinct integers, 
and a(l), a(2), . . . , a{p) are (not necessarily distinct) positive integers, then by the Remark 
in step 2.4(A), 



E 



iiWi)"" -n^«i,)°"=sn^<-;=£ 

.i=l J i=l i=l 



a{i) 



.1=1 



a{i) 
kit) 



Thus for any L-tuple (/c(l), /c(2), . . . , A;(L)) e (the A;(£)'s need not be distinct), 
-^[nt=i ^fc(i)] — -^[n^=i ^k{i)\- Adding up both sides over all L-tuples e , one obtains 

^[E.e^W^r]'' < E[Y.keS Zk]"^ ■ Since /:(E.e5^^) = iV(0,card5) = £((card5)V2z), 
eq. (3.3) follows. That completes the proof of (3.1) and of Lemma 3.2. 

Step 3.3. Let ki, K2, K3, ... be a sequence of independent, identically distributed random 
variables, taking their values in the set {0, 1, 2, . . . , L — 1} and uniformly distributed on 
that set. 

Define the random variables J(n), n e {0, 1, 2, . . . } as follows: 



J(0) := (constant), and for each n G N, J(n) ^ L"* ^ 



(3.4) 



u=l 



17 



Remarks. Recall that in the base-L number system, for a given n > 1 and a given 
P e {0, 1, 2, . . . , L"^ — 1}, there is a unique representation /? = Ylu=i L^~^^u such that 
Oil, q;2, . . . , QJn e {0, 1, . . . , L - 1}. Also, by (3.4), 

Vn e N, J{n) = L^'-^n + J{n - 1). (3.5) 

From those facts and trivial arguments, one has the following observations: 

Remark 1. For each n G {0, 1, 2, . . . }, the random variable J{n) takes its values in the 
set {0, 1, 2, . . . , — 1} and is uniformly distributed on that set. 

Remark 2. For each n G N (and each a; e Q), J(n) > J(n — 1) and in fact 

- J(n) < - J(n - 1) < 

< - J(n - 1) + L"-^ - 1 < -J{n) + - 1. (3.6) 

(For the last inequality, apply (3.5) and the fact L^-^k^ < L"-i(L - 1) = - L^-^) 

Remark 3. For each n e N and each a; e such that 1 < Kn{uj) < L — 2, one has 
(again by (3.5)) that 

- J{n){u)<-L''-^ - J{n-l){uj) and 

(-J(n - l)(a;) + L"-^ - 1) + L^-^ < (- J(n)(w) + L'^ - 1). (3.7) 

Remark 4- For each n e N and each j e {0, 1, 2, . . . , L" — 1}, there exists a unique 
choice of integers jo £ {0, 1, 2, ... , L"~-^ — 1} and A;o G {0, 1, . . . , L — 1} such that 

{ J(n) = i} = { J(n - 1) - io} n {Kn = ko}. (3.8) 

Remark 5. For each n e N, the two random variables J(n— 1) and k„ are independent. 

Step 3.4. For each n e {0, 1, 2, . . . }, we shall construct a sequence X^'^^ := {xj^\ k e Z) 
of random variables. The definition will be recursive, and is as follows: 

(A) To start off, let X(o) := (xf \ A; e Z) be a sequence of independent, identically 

distributed random variables such that (i) £(Xq°^) = AunpsS (again see step 2.4(A)) and 
(ii) this sequence X^^^ is independent of the sequence (ki, K2, n^, . . .) in step 3.3. 

(B) Now suppose n > 1, and the random sequence X^^~^'' := {xj^ ^\ k & X) is 
already defined. Define the random sequence X^") := {xj^\ /c e Z) as follows: 

For a given a; e f2, in the notations in step 2.2(a) (d) and step 2.3(C), 

{Xl''\u) : -J{n){co) <k< -J{n){oj) + - 1) 

r ^LUn-i)AX^r^\u) : -J{n){u) < k < -J{n){io) + - 1) 
J if J(n)(c^) = J(n- l)(a;) 

I V'LT(n-i),o(4""'^('^) ■■ -Jin)i^) <k< -J{n){u) + - 1) 
I ff J(n)(a;) > J(n- l)(a;), 

(3.9) 
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and for every integer K e Z — {0}, 

(X^"^(a;) : -J{n){uo) + KL"" <k< -J{n){uj) + KL" + - 1) 

:= V'LT(n-i),o(4"~'^(^) ■■ -<^H(^) + KL''<k< -J(n)(a;) + KL" + - 1). 

(3.10) 

That completes the recursive definition. By induction on n, one has (see step 2.2(h)) 

that 

Vn e N, (t(X('^)) C ct(X(°)) V ct(m, H2, . . . , Kn). (3.11) 

By step 3.3 and paragraph (A) (property (ii)) above, one now has that for aU n e 
{0, 1,2,...}, the two cr-fields a{J{n), X^'^^) and a{Kn+i) are independent. 

Lemma 3.5. For each n e {0, 1, 2, . . . }, one has that 

V j e {0, 1, 2, . . . , - 1}, C (x^Vfe, keZ I J(n) =j)=V (L", ^^r^) . (3.12) 

Proof. Eq. (3.12) holds for n = by (3.4) and step 3.4(A), step 3.1, and step 2.4(B). 

Now for induction, suppose that n > 1, and that (3.12) holds with n replaced by n — 1. 
To complete the induction step and the proof, our task is to prove (3.12) for the given n. 

Referring to (3.12) suppose j G {0, 1, 2, . . . , — 1}. 

Referring to step 3.3 (its Remark 4), let jo ^ {0, 1, ... , L"~^ — 1} and /cq G {0, 1, . . . , L— 
1} be such that (3.8) holds. By the sentence after (3.11), the cr-fields a{J{n — 1), X^'^~^^) 
and (j{Kri) are independent. Hence by (3.8) and a simple calculation, 

V5 e a(x(-i)), P{B I J{n) = j) = P{B \ {J{n - 1) = jo} n = k^}) 

= P{B\J{n-l)=jo). (3.13) 

Now by (3.8) and (3.5), j = L'^~^ko + jo. By the induction hypothesis, 

>C {x^-m+k^ keZ\J{n-l)= jo) = V (L"-i, //,_i) (3.14) 

(where jo is also written as j(0) for typographical convenience). Also (see step 2.4(B)), 
the distribution P(L"~^, Hn-i) on is invariant under a shift of the indices by (any 
multiple of) L"-^ Hence by (3.14), 

>C {x^-f+l keZ\J{n-l)= jo) = V {L'^-\f,n-i) • 

Hence by (3.13), 

C {X^^f+Z I J{n) =j)=V {L^-\^ir^-l) . (3.15) 
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Referring to step 2.2(d), consider the following three classes of random vectors for 
K e Z: 

Q'j^ := [X^^-^^ : -j + KL"-i <k<-3 + KL""-' + L"-^ - l) , 
Ck ■■= (4""'^ ■ -j + KL''<k< -j + KL"^ + - l) , 
Q'll ■- (^X^^'^ : -j + KL" <k<-j + KL"" + - l) . 

Referring to (2.4), note that for each K e Z, Ck = (C£k I Clk+i I Clk+2 I ' ' ' I Clk+l-i)- 
Also, by (3.9)-(3.10) (and the inclusion {J{n) = j} C {J{n - 1) = jo} from (3.8)), 
for each K e Z, either (if K 0, or K = and j > jo) Cxi^) = V'LT(n-i),o(CK(^)) 
for all u; e {J{n) = j}, or (if = and j = jo) Ck(^) = ^LUn-i),i{CKi^)) all 
Lv G {J{n) = j}. Now by (3.15) and step 2.4(B), conditional on the event { J(n) = j}, the 
random vectors ('j^, K E Z are independent and have distribution Hn-i- Hence conditional 
on {J{n) = j}, the random vectors C^, K & Z are independent. Hence by step 3.1 and 
Lemma 2.8(B), conditional on {J(n) = j}, the random vectors ('^, K e Z are independent 
and have distribution fx^- Thus by step 2.4(B), eq. (3.12) holds for our given n and j. Since 
je{0,l,...,L"^ — 1} was arbitrary, that completes the induction step and the proof. 

Lemma 3.6. For each n e N, the random sequence X^") is strictly stationary and satisGes 
C{X^^) = Aunps3 (see step 2.4(A)) and {L — l)-tuplewise independence, and the random 
variables \xj^^\, k eZ are independent. 

Proof. Let n e N be arbitrary but fixed. 

To prove strict stationarity, let ( := (Cfc, G Z) be a random sequence such that 
(see step 2.4(B)) £(C) = T>{L"', fin)- For each i G Z, define the probability measure r]i on 

by rji := C{Q-^kj k G Z). Then rjQ = T>[C^^ fi^), and from step 2.4(B) one has the 
"periodicity" ?7i+Ltn = ?7i for z G Z. By Lemma 3.5, if j G {0, 1, . . . , L"' — 1} then £(xi'^-^^^, 

/c G Z I J(n) = j) — r]o, and if also i G Z then jC{X^j_^i^_^^, G Z | J(n) = j) = rji. Hence 
by step 3.3 (its Remark 1) and a simple calculation, for any z G Z, 



C{xillkez) 





(LTn)- 


1 


= 


■ E 

j=0 


c(xlllkeZ\Jin)=j) 




(LTn)- 


-1 


= 


■ E 

i=o 


^(^-.W+.'^eZ| J(n) 




(LTn)- 


-1 {L1n)-1 


= 


■ E 


Vi+j = L'"" ■ ^ llu 









where the last equality comes from the "periodicity" mentioned above. The last expression 
does not depend on i. Hence the sequence X^"^) is strictly stationary. 

Next, by Lemma 3.5, step 3.1 (its Remark), Definition 2.6(b)(c)(d), and step 2.4(B) 
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(and where necessary a trivial extra argument), one has the following observations: First, 

£(x("))=L-"/^X;'£(x(")|J(n)=,) 
j=o 

(LTn)-l 

= L " • '^unpsS = '^unpsS- 

3=0 

Second, if k{l), k{2), . . . , k{L — 1) are any choice of L — 1 distinct integers, then (with a 
notation at the end of step 2.4(A)) 

{L]n)-1 



3=0 

(LTn)-l 



= L" 



unps3 unps3 



and hence the sequence X^") satisfies (L — l)-tuplewise independence. Third, by a similar 

(n) 

argument, the random variables \Xj^ k E 7i are independent. The proof of Lemma 3.6 
is complete. 

Lemma 3.7. Suppose h and m are positive integers such that m < h. Suppose p is a 
positive integer such that p > 2L™. Then (recall the sentence preceding Lemma 3.2) 



E 



.k=l 



(h) 
k 



< E 



^1/2^1 _2-I-.^!.^(m-l)L/2_ 



(3.16) 



Proof. By Lemma 3.5 and Lemma 3.2, for each j e {0, 1, . . . , L'^ — 1}, 



E 



.fe=i 



(h) 
k 



J{n) =j\< [RHS of (3.16)]. 



Hence by step 3.3 (its Remark 1) and a trivial calculation, (3.16) holds. 

Lemma 3.8. There exists an event G with P{G) = 1 such that the following holds: For 
every co E G and every k E Z, there exists a positive integer m = m{uj, k) such that 



yn>m, Xi-\u;)=xt\u;). 



(3.17) 



Proof. First some preliminary calculations will be useful. 

Suppose uj e fl, n > 1, and J(n)(a;) = J{n — Then by (3.9) and step 2.3(C), 

X^"^(a;) = Xl''~^\uj) will hold for alike Z such that - J(n)(a;) <k< -J(n){uj)+L'' - 1 
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with the possible exception of the indices k such that —J{n){u) -"^ < A; < — J(n)(a;) + 

2L'^-i _ 1. Thus (if J{n){uj) = J{n - ^(w) = X^^~^\ijS) wiU hold for aU k such 

that — J(n)(a;) < k < — J(n)(a;) + L"~^ — 1, that is, for all k such that 

-J(n - l){uo) <k< -J{n - 1){uj) + L""^ - 1. (3.18) 

Now suppose u; G O, n > 1, and (instead) J{n){uj) > J{n — l){uj). Then by (3.5), 
J{n){u) > J{n - l){u) + L^-i and hence -J{n){u;) + L^-^ < -J{n - l)(a;); and also by 
(3.9) and step 2.3(C), xj^\uj) = xj^ ^\^^) will hold for (at least) all integers k such that 
—J{n){uj) + L'^~^ < k < —J{n){uj) + L"^ — 1, and in particular (see also the last inequality 
in (3.6)) for all integers k such that (3.18) holds. 

By the preceding two paragraphs, one has that if a; e and n > 1, then X^\uj) = 

xj^~^\u>) for all integers k such that (3.18) holds. 

Hence by (3.6) and induction, one has that if uj E Q, n > 1, and k satisfies (3.18), 
then Xi-'\u) = X^-\u) = X^-+'\u) = = • • • • 

Now define the event G by 

G := {1 < < L — 2 for infinitely many n e N}. 

By (2.1) and step 3.3, P(l < Kn ^ L — 2) > 2/3 for each n e N, and hence by step 3.3 
and the (second) Borel-Cantelli Lemma, P{G) — 1. Also, for each a; e G, [LHS of (3.18)] 
— ^ — oo and [RHS of (3.18)] — oo as n — > oo by (3.7). Hence for every uj e G and 
every k E Z, there exists n G N such that (3.18) holds. Hence by the observation in the 
preceding paragraph. Lemma 3.8 holds. 

Step 3.9. Define the sequence X := (X/-, A; e Z) of random variables as follows: For each 
keZ, 

Xk := lim xl'^K (3.19) 

n-»oo 

By Lemma 3.8, for each k E Z, this limit exists almost surely. 

Step 3.10. The task now is to show that the sequence X defined in (3.19) has all of the 
properties stated in Theorem 1.1. 

Suppose p is a positive integer and A;(l), A;(2), . . . , k{p) are distinct elements of Z. By 
(3.19), for any p-tuple {ti,t2, . . . ,tp) e W, one has that I]f=i ^i-'^Ij') — ^ I]r=i ^i^fc(i) 
a.s. as n — > oo. Hence by [1, p. 330, Theorem 25.2, and p. 383, Theorem 29.4], 

^(4(iV4?2V---'4(p)) ^^(^fc(i)'^M2),...,^fc(p^ asn^oo (3.20) 

(weak convergence on R^). Recall the elementary fact that for weak convergence on R^, 
the limiting distribution is unique. 

For a given j E Z and a given m e N, one has that 
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for each n > 1 by Lemma 3.6, and hence by (3.20) one has that 

^ • • • ) -^i+m) = (Xi, X2, . . . , . 

Hence the sequence X is strictly stationary. 

Since C{X^^) = Aunpss for each n G N by Lemma 3.6, it foUows from (3.20) that 
C{Xq) = AunpsS- Thus property (A) in Theorem 1.1 holds. 

In the case p = L — 1, the left side of (3.20) is A^^pg] for each n G N by Lemma 

3.6 (see the end of step 2.4(A)), and hence the right side of (3.20) is also A^^pg^]. Thus 
property (B) (here (L — l)-tuplewise independence) in Theorem 1.1 holds (see step 2.1). 

Property (C) in Theorem 1.1 holds by a similar argument involving Lemma 3.6 and 
eq. (3.20) with p arbitrarily large. 

Step 3.11. The final task is to prove property (D) in Theorem 1.1. Recall the notations 
for partial sums in eq. (1.1). 

By property (A) (proved above) in Theorem 1.1, and a routine calculation, EXq = 0, 
EXq = 1, and EXq — 9/5. Recall eq. (2.1) and the property of (L — l)-tuplewise 
independence (proved above) for the sequence X. One has that 

Vn>l, E (n-^/^S{X,nfj =0 and (3.21) 

Vn>l, E (n-^/^S{X,n)y = 1. (3.22) 

Further, by the well known, elementary calculation in [1, p. 85, proof of Theorem 6.1] 
(which requires only 4-tuplewise independence), one has that for each n G N, 

E{S{X, n))^ = n • EX^ + 3n{n - 1) {EX^f 

= n ■ (9/5) + {3n^ - 3n) • 1 < 3n^ 

Hence ^ 

Vn>l, E (n-^/^S{X,n)^ < 3. (3.23) 

By (say) (3.22) and Chebyshev's inequality, the family of distributions of the normalized 
partial sums n~^^'^S{X, n), n G N is tight. 

Now for the proof of property (D) in Theorem 1.1, suppose Q is an infinite subset of 
N. Because of tightness, there exists an infinite set T C Q and a probability measure // 
on R (both T and /x henceforth fixed) such that 

n n) =^ as n ^ 00, n (3.24) 

To complete the proof of property (D) in Theorem 1.1, our task now is to show that /i is 
neither degenerate nor normal. 

Because of (3.23), (3.24), and [1, p. 338, the Corollary], one has by (3.21) and (3.22) 

that 

/ xii{dx) = and / x^ii{dx) = 1. (3.25) 
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Hence the probability measure n has positive variance and is therefore nondegenerate. 

If /U were normal, then by (3.25) it would have to be the A^(0, 1) distribution. Because 
of (3.24) and [1, p. 334, Corollary 1, and p. 338, Theorem 25.11], to show that fj, fails to 
be normal, it now suffices to show (see the sentence preceding Lemma 3.2) that 



-L 



Vn > 2L, E (n-^/^S{X, n)) < EZ^ - 8'^/^ ■ L\ ■ 

Let M > 2L be arbitrary but fixed. Let m e N be the integer such that 

2L"" < M < 2L'"+^ 
By (3.27) and Lemma 3.7, for all n > m. 



(3.26) 



(3.27) 



E 



S{X^'^\M) 



< E 



1 L 



(3.28) 



Now for each n e N, [5(X('^), M)]-^ < a.s. (since < 3^2 a.s. for each 

A; e Z by Lemma 3.6), and hence by (3.19) and dominated convergence, E[S{X^'^\ M)]^ 
E[S{X,M)]^ as n ^ oo. Hence by (3.28), 

E[S{X, M)]^ < E[M^/^Z]^ - 2-^ ■ L\ ■ l^^-^^l/2_ 
(That also follows simply from Fatou's Lemma.) Hence by the second inequality in (3.27), 

E M-'^/^S{X, M)]^ < EZ^ - 2-^ ■ L\ ■ L^^-^)^/^ . M'^/^ 

< EZ^ - 2-^ ■ L\ ■ L^^-'^)L/^ . (2L^+i)-'^/2 
= EZ^ - 2-3^/2 . LI ■ L-^. 

Since M > 2L was arbitrary, eq. (3.26) holds. That completes the proof that is non- 
normal, and that property (D) in Theorem 1.1 holds. The proof of Theorem 1.1 is complete. 
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